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(currently amended) The use of multiple threads in association with a network 
processor and accessible data available in a tree search structure, including the 
steps of: 

a) providing multiple instruction execution threads as independent processes 
in a sequential time frame; 

b) au e u ein q queuing the multiple execution threads to have overlapping access 
to the accessible data available in said tree search structure; 

c) executing a first thread in the queue; and 

d) transferring control of the execution to the next thread in the queue upon the 
occurrence of an event that causes execution of the first thread to stall. 

(original) The use of the multiple threads according to claim 1 wherein the control 
of the execution is temporarily transferred to the next thread when execution stalls 
due to a short latency event, and the control is returned to the original thread when 
the event is completed. 

(original) The use of multiple threads according to claim 2 wherein a processor 
instruction is encoded to select a short latency event. 

(original) The use of the multiple threads according to claim 1 wherein full control 
of the execution is transferred to the next thread when execution of the first thread 
stalls due to a long latency event. 
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(original) The use of multiple threads according to claim 4 wherein a processor 
instruction is encoded to select a long latency event. 

(currently amended) The use of multiple threads according to claim 1 including 
q tte ue i ng queuing the threads to provide rapid distribution of access to shared 
memory. 

(original) The use of the multiple threads according to claim 1 wherein the threads 
have overlapping access to shared remote storage via a pipelined coprocessor by 
operating within different phases of a pipeline of the coprocessor. 

(original) The use of the multiple threads according to claim 1 further including the 
step of providing a separate instruction pre-fetch buffer for each execution thread, 
and collecting instructions in a prefetch buffer for its execution thread when the 
thread is idle and when the instruction bandwidth is not being fully utilized. 

(original) The use of the multiple threads according to claim 1 wherein the threads 
are used with zero overhead to switch execution from one thread to the next. 

1 10. (original) The use of the multiple threads according to claim 9 wherein each thread 

2 is given access to general purpose registers and local data storage to enable 

3 switching with zero overhead. 

1 11. (currently amended) A network processor that uses multiple threads to access 

2 data, including: 

3 a) a CPU configured with multiple instruction execution threads as independent 
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4 processes in a sequential time frame; 

5 b) a thread execution control for 

6 1 ) ou e u ei na queuing the multiple execution threads to have overlapping 

7 access to the accessible data; 

8 2) executing a first thread in the queue; and 

9 3) transferring control of the execution to the next thread in the queue 

10 upon the occurrence of an event that causes execution of the first 

1 1 thread to stall. 

1 12. (original) A processing system utilizing multiple threads according to claim 1 1 

2 wherein the thread execution control includes control logic for temporarily 

3 transferring the control to the next thread when execution stalls due to a short latency 

4 event, and for returning control to the original thread when the latency event is 

5 completed. 

1 1 3. (currently amended) The processing system according to claim 4+ 1,2 wherein a 

2 processor instruction is encoded to select a short latency event. 

1 14. (original) The processing system according to claim 11 wherein the control 

2 transfer means includes the means for transferring full control of the execution to the 

3 next thread when execution of the first thread stalls due to a long latency event. 

1 15. (original) The processing system according to claim 14 wherein a processor 

2 instruction is encoded to select a long latency event. 
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to Office Action of Feb. 1 1 , 2003 

(original) The processing system according to claim 1 1 including means to queue 
the threads to provide rapid distribution of access to shared memory, 

(original) The processing system according to claim 1 6 wherein the threads have 
overlapping access to shared remote storage via a pipelined coprocessor by 
operating within different phases of a pipeline of the coprocessor. 

(original) The processing system according to claim 1 1 further including a 
separate instruction pre-fetch buffer for each execution thread, and means for 
collecting instructions in a prefetch buffer for an idle execution thread when the 
instruction bandwidth is not being fully utilized. 

(original) The system according to claim 1 1 wherein the processor uses zero 
overhead to switch execution from one thread to the next. 

(original) The system according to claim 1 9 wherein each thread is given access 
to an array of general purpose registers and local data storage to enable switching 
with zero overhead. 

(original) The system according to claim 20 wherein the general purpose 
registers and the local data storage are made available to the processor by 
providing one address bit under the control of the thread execution control logic and 
by providing the remaining address bits under the control of the processor. 

(original) The system according to claim 20 wherein the processor is capable of 
simultaneously addressing multiple register arrays, and the thread execution control 
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3 logic includes a selector to select which array will be delivered to the processor for 

4 a given thread. 



1 23. (original) The system according to claim 20 wherein the local data storage is fully 

2 addressable by the processor, an index register is contained within the register 

3 array, and the thread execution control has no address control over the local data 

4 storage or the register arrays. 

1 24. (currently amended) A network processor configuration comprising: 

2 a CPU with multiple threads; 

3 an instruction memory, and a separate prefetch queue for each thread 

4 between the instruction memory and the CPU; 

5 an array of general purposes registers, said array communicating with the 

6 CPU; 

7 a local data storage including separate storage space for each thread; 

8 a thread execution control for the general register array and the local data 

9 storage; 

10 a first coprocessor connecting the CPU to a local data storage, sto r ag e; 

11 said thread execution control including priority FIFO buffer to store thread numbers: 

12 a shared remote storage; and 

13 a pipelined coprocessor connecting the shared remote and the CPU. 

1 25. (currently amended) The processor configuration according to claim 24 wherein 

2 the thread execution control further includes a p r iori ty T i ro, a plurality of thread 

3 control state machines, one for each execution thread, and an arbiter responsive to 

4 signals from the FIFO buffer and the state machine to determine thread execution 
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5 Priority . 

1 26. (original) The use of prefetch buffers in connection with a plurality of independent 

2 instruction threads used to process data in a Network Processor comprising the 

3 steps oft 

4 associating each thread with a prefetch buffer; 

5 b) determining whether a buffer associated with an execution thread is 

6 full; 

7 c) determining whether the thread associated with the buffer is active; 

8 and 

9 d) during periods that the buffer is not being used by an active execution 

10 thread, enabling the buffer to prefetch instructions for the execution 

11 thread. 

1 27. (currently amended) A thread execution control useful for the efficient execution of 

2 independent threads in a n e tw o rk processor comprising: 

3 a) k priority FIFO buffer for storing thread numbers ; 

4 b) a plurality of thread control state machines, one for each thread; and 

5 c) art arbiterfor determining the thread execution priority among multiple 

6 thrteads based upon signals outputted from the FIFO buffer and the 

7 staVe machines . 

1 28. (currently amended) The thread execution control according to claim 27 wherein 

2 the FIFO includes ^ 

3 a) mean^for loading a thread number into the FIFO when a packet is 

4 dispatched to the processor; 
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AM 

5 b) means for unloading a thread numberfrom the FIFO when a packet 

6 has been enqueued for transmission; 

7 (c) thread number transfer from highest priority to lowest priority in the 

8 FIFO when a long latency event occurs, and 

9 (d) the thread outlets of the FIFO used to determine priority depending 
10 on the length of time a thread has been in FIFO. 

1 29. (original) The thread execution control according to claim 27 wherein the arbiter 

2 controls the priority of execution of multiple independent threads based on the 

3 Boolean expression: 

4 

5 G n =R rt {(P A =n)+R PA (P B =n)+R PA R pb ' (P c =n) • ■ } 

6 where: G is a grant 

7 R n is a request from a given thread; 

8 P A i Pb and Pc represent threads ranked by alphabetical subscript 

9 according to priority; 

10 n isa subscript identifying a thread by the brt or binary number 

1 1 comprising 

12 a) determining whether a request R is active or inactive; 

1 3 b) determining the priority of the threads; 

14 c) matching the request R with the corresponding thread P; and 

15 d) granting a request for execution if the request is active and if 

16 the corresponding thread P has the highest priority. 
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1 30. (currently amended) The thread execution control according to claim 27 wherein 

2 the thread control state 

3 machine comprises control logic to : 

4 (a) dispatch a packet to a thread; 

5 (b) move the thread from an initialize state to a ready state; 

6 (c) request execution cycles for the thread paeket; 

7 (d) move the thread to the execute state upon grant by the arbiter of an 

8 execution cycle; 

9 (e) continue to request execution cycles while the thread paeket is 

10 queued in the execute state; and 

1 1 (f) return the thread packet to the initialize state if there is no latency 
] 2 event, or send the packet to the wait state upon occurrence of a 
1 3 latency event. 

31 . (New) The thread executing control according to claim 28 wherein the FIFO 
further includes means to detect occurrence of latency events. 



10 



Received from < 9192542649 > at 6/1 1/03 1 :08:48 PM [Eastern Daylight Time] 



